Control of neural chaos by synaptic noise 
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Abstract 

We studied neural automata — or neurobiologicaUy 
inspired cellular automata — which exhibits chaotic 
itinerancy among the different stored patterns or 
memories. This is a consequence of activity- 
dependent synaptic fluctuations, which continu- 
ously destabilize the attractor and induce irregu- 
lar hopping to other possible attractors. The na- 
ture of the resulting irregularity depends on the 
dynamic details, namely, on the intensity of the 
synaptic "noise" and on the number of sites of the 
network that are synchronously updated at each 
time step. Varying these details, different regimes 
occur from regular to chaotic. In the absence of ex- 
ternal agents, the chaotic behavior may turn reg- 
ular after tuning the noise intensity. It is argued 
that a similar mechanism might be at the origin of 
the self-control of chaos in natural systems. 

1 The model and its motiva- 
tion 

We report on the complex dynamics and possible 
applications of a novel neural automaton or cel- 
lular automaton (Wolfram(1984), inspired in neu- 
robiology. The model exhibits dynamic asso- 
ciative memory, including kind of switching be- 



havior that has been reported for neural net- 



works with dynamic synapses Pantic et al.(2002) 
Cortes et al.(2004)| , [Abbott and Regehr(200'4] 



Our automaton incorporates fast fluctuations of 
synaptic intensities which depend on neuron ac- 
tivity. Such "noise" induces instability of the re- 
calling dynamics in a way that mimics how the 
brain efficiently solves some complex tasks. In fact, 
a rapid response to highly changing stimuli is be- 
lieved to play a functional role during both atten- 
tion and sequential processing of parallel sensory 
information [Cortes et al.(200'5)]. In this report , 
we adapt a previous proposal [Marro et al.(2005) 



to show that fast synaptic noise can control the 
complexity and chaoticity of dynamics and, in 
particular, the details of the temporal oscilla- 
tions of the neural activity. Unlike in earlier 
Molgedey et al (1992)[ , [Schiff et al.(T994) 



work 



Freeman et al.(1997) the noise intensity in the 



present mechanism varies autonomously, which 
could be more relevant to the self-control of chaos 
in neural systems as well as in other cases. 

The model consists of N cooperative and, for 
simplicity, fully-connected neurons with stochas- 
tic dynamics^. A main feature is that, at each 
time step t, the individual states of n < A'^ neu- 
rons are simultaneously updated. This is per- 
formed according to a modification of the Hop- 



field prescription Amari(1972) , Hopfield(1982) 



[Amit(1989) . We assume that each neuron Si, en- 



dures a current or a local field Gardiner(2004) 



^Some conse quences of other n etwork topologies have 
been studied in [Torres et ah(2004)| , for instance. 
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[Bibitchkov et al.(2002)| : 



w^jXjSj. This is consis- 



h,{S) = I /i,(S,X)P(X|S)dX. (1) 

Here, S = {.s^; i = 1, iV} is a neuron con- 
figuration and X = {xi} stands for a set 
of random variables, X = {a^i}, each af- 
fecting a postsynaptic neuron, of distribution 
P(X|S). This amounts to assume short-time, 
rapid synaptic fluctuations which, in fact, are 
known to influence and often determine the neu- 
ron activity in many nat ural processes. See 
[Marro and Dickman(1999)| for a technical ju st ifi- 



cation of ((TJ, and Abbott and Regehr(2004) for a 
recent discussion on the role of synaptic noise, for 
instance. 

This model has already been analyzed both 
analytically and numerically for certain choices 
of parameters. In particular, the case n = \ 
of "sequential updating" was shown to exhibit 
complex hopping between the attractors in some 
Cortes et al.(2005)] , and we recently demon- 



strated~ |Marro et al.(2005) that the hopping may 



become chaotic for Little dynamics, namely, n — N. 
We here illustrate a typical situation between these 
two limits by means of computer simulations. The 
case with 1 < n < TV for which we present some 
results here happens to be relevant to understand 
the possibility of controlling chaos of the neural ac- 
tivity by means of synaptic "noise" . 

In order to deal with model simulations that re- 
main versatile enough, we need to introduce some 
simplifications in the following; notice, however, 
that some of them may turn irrelevant to the re- 
sulting emergent behavior. Most convenient is to 
restrict ourselves to binary neurons, i.e., Si = ±1, 
which are known to capture the essentials of co- 
operative phenomena .Abbott and Kcplcr(1990) , 
[Pantic et al.(2002) . Concerning the stochastic 
variable, we need to determine both its nature 
and its distribution. A simple choice is to assume 
that synaptic intensities are of the form 

X 



where w\j are average weights which, also for 
the sake of simplicity, we shall consider to be of 
the Hebbian type. That is, w];^ = 
where (with /x = 1, M) stands for M (binary) 
patterns that are assumed hereafter to be stored 
in the system. It then naturally follows stochas- 
ticity of the presynaptic currents in (^) which are 



given by /.,(S,X) =E,^,u;L 
tent with actual features of natural systems such 
as, for example, variations of the glutamate con- 
centration in the synaptic cleft, and differences in 
the potency released from different locations on the 



active zone of the synapses Franks et al.(2003) 
These and similar "noises" which cause synaptic 
fluctuations are typically very fast compared to 
the time relaxation of the whole neuron system. 
Therefore, it seems sensible to assume that, in the 
time scale for the neuron activity, neurons behave 
as in the presence of a steady distribution for the 
synaptic fluctuations. This is taken into account 
by means of the distribution P(X|S) in a sit- 
uation which is discussed with further detail in 



Marro and Dickman(1999)| . 



2 Synaptic noise 

Recent neurobiological findings 

Abbott and Regehr(2004)] , concerning activity- 
dependent processes may help in determining 



In particular, it was reported shor t-time 

depression 



Tsodyks et al.(1998) 



I.e., 
under 



P(X|S). 

synaptic 

that synaptic weights tend to decrease 
repeated presynaptic activation. A simple way of 
implementing this in is by taking 

P(X|S) =\{{p (m) 5{x, + $) + [1 - p (rii)] 5{x, - 1)} , 

i 

J2) 

where the factorization is for simplicity and m = 
rh(S) is the Af -dimensional overlap vector of com- 
ponents m^(S) — N^^ Si- In accordance with 
the mentioned observation, |2Jl implies that increas- 
ing the mean firing rate, which will increase the 
probability function p (m) , will make more likely 
that synaptic intensities decrease by a factor of 
$. The Hopfield model, for which such depress- 
ing noise is absent, corresponds here to the limit 
Finally, in order to fully determine the 
model, one may use the choice Cortes et al.(2005)] 
C (m) = (1 + Y.U ["i"" (S)] ' , where a = M/N 
is the network load parameter [Hertz et al. (199X7 



After some straightforward algebra, one obtains the 
effective currents as 



h,iS) = 1 - 



1 + $ 

1 + a 
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Figure 1: This shows the time variation of the overlap 
m = m^(S) between the current neural activity, S, and 
the only pattern which is stored in the synaptic weights, 
i.e., for M = 1, as obtained in a Monte Carlo simulation 
with A'^ — 3600 neurons and a depressing factor <E> = 
0.043. The top graph is for T — 0, i.e., in the absence 
of thermal fluctuations, while the bottom graph is for 
r = 0.51. 



In addition to the discussed synaptic stochastic- 
ity, that we represent here by means of the vari- 
able X, there are independent causes for assum- 
ing an stochastic dynamics of the neuron system. 
That is, a neuron may sometimes remain silent 
even if it endures a large current. This is natu- 
rally modelled by introducing a "temperature" pa- 
rameter T. In practice, one usually assigns a prob- 
ability which depends on {hi — 9i) /T, where 9i is a 
threshold, to the change according to sig(ft,j) — st 
at time t. This mechanism is equivalent to assume 
the existence of a hypothetical "thermal bath" 
which induces stochasticity of the neuron activity 
by means of a master equation. In general, this 
equation implies a tendency towards equilibrium. 
However, in the present case, the canonical ten- 
dency competes with the stochastic changes of hi, 
which impedes equilibrium, and the system goes 
asymptotically to a non-equilibrium steady state 
[Marro and Dickman(1999)] . This complex, non- 
equilibrium situation is at the origin of the intrigu- 
ing behavior we describe next. 



1 



r If 



25000 50000 75000 100000 



<i>=0.046 



25000 50000 75000 100000 

<i>=0.048 



25000 50000 75000 100000 

<i>=0.055 



r I 



ill 



25000 50000 75000 100000 

<i>=0.065 



umiNH.iii'ii ^,^1 1 mill 



5000 10000 15000 20000 

time (MCS) 

Figure 2: Monte Carlo simulations in the absence of 
thermal fluctuations, T = 0, for a single stored pattern 
and A*' = 3600 neurons showing the effect of varying 
the synaptic noise parameter $. The resulting hopping 
shows dramatic variations of temporal scale and degree 
of complexity as one varies $. 

3 Computer simulations 

The above programme was implemented in the 
computer by iterating the following Monte Carlo 
algorithm: 



1. Store M different patterns in the aver 
age weights w\j accc 
Hebb's learning rule. 



age weights w\j according to the chosen, e.g., 



2. Set any state S = {si} at random. 

3. Compute the N local fields /ii(S) as defined in 

4. Choose a site (neuron) at random, repeat the 
choice N times and keep only the n < N sites 
which differ from each other (this procedure 
lets you with n ^ sites — for the values of 
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Figure 3: The entropy function, as defined in tlie main 
text, for different time series obtained during Monte 
Carlo simulations of neural automata for difi^erent val- 
ues of the synaptic noise parameter $ . Decreasing 
values of the entropy indicate a tendency towards reg- 
ularization of the complexity of the time series. The 
graph reveals different regimes of chaoticity. 



provide a quantitative description of the complex- 
ity of this hopping. Using standard fast Fourier 
transform algorithms, we computed the power 
spectra P{ri). The normalized probability p,, = 
P{r]) I 'Y^^ P(j]) then allows one to define a regular 
entropy as, S = — ^^Pri log2Pr)- This quantity has 
been used before to detect regularity out of chaotic 
activity in actual neurons [Varona et al.(2001)| . As 
a matter of fact, S' > is to be associated with 
chaotic behavior while 5 = would correspond to 
periodic dynamics. 

Figure 01 depicts the entropy which results in our 
case as a function of $. This shows a minimum 
which corresponds to the smallest degeneration in 
the time series of figure |2| (second graph from the 
top). Decreasing S indicates a tendency to regu- 
larization or smaller chaoticity, while higher chaos 
and irregularity in the time series corresponds to 
larger values of S. 

4 Conclusions 



N of interest here).^ 

5. Perform the changes Si — > —Si at the chosen 
n sites using the standard rate u}{s\ Si) = 
\{\-s\ tanh [/3MS')]}. 

6. Increase time in one unit, and go to step 3. 

Figure ^ illustrates the resulting behavior for 
a single pattern, i.e., it corresponds to the limit 
a — > 0. This shows a complex hopping process be- 
tween the pattern, and the anti-pattern, 
The figure compares the evolution at a finite tem- 
perature with that in the absence of thermal fluc- 
tuations to demonstrate that hopping is not a con- 
sequence of the latter. Consequently, in order to 
avoid the short-length oscillations shown in the 
bottom graph of figure Q which are induced by the 
thermal noise, we are concerned in the following 
with simulations at T = 0. 

Figure 12 illustrates a main result, namely, that 
the frequency and other details of the hopping 
strongly depend on the value of the parameter $ 
which modulates the fast synaptic noise. An ap- 
propriate measure of the associated entropy will 

^ Both Monte Ca rlo simulations and analytical results 
[Cortes et al.(2006)| are in full-agreement and, in the ther- 
modynamic limit, one has that n/N = 1 — 1/e. 



We have introduced a class of hybrid neural au- 
tomata with two main features. On one hand, these 
models provide a convenient arena to analyze the 
influence of fast synaptic noise on the retrieval pro- 
cess. On the other hand, they may describe a con- 
tinuous transition from sequential, single-neuron 
updating to the case of Little dynamics or parallel 
updating as one varies the model parameter n. The 
synaptic noise is modelled trying to mimic recent 
observations, namely, the noise occurs in a short- 
time scale and conveniently couples to the neuron 
activity to induce synaptic depression. Depending 
on the intensity of this depression, the model ex- 
hibits a varied emergent behavior, including chaotic 
hopping between the attractors. This results in a 
rather complex pattern of neural activity. Monitor- 
ing the entropy suggests how a fast noise might pro- 
vide a mechanism to control chaos in living systems 
[Garfinkelet al.(1992)| , [Schiff et al.(1994)| . The 
design of a mechanism in which noise intensity 
varies autonomously could be useful to the self- 
control of chaos. Notice in this respect that manip- 
ulating n in the model might be convenient for the 
purpose. That is, two main cases follow altogether 
from the present analysis and some previous work 
[Cortes et al. (2005)1 , [Marro et al.(2005) 



(1) n 



1, for which the system is sensible to an external 
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stimulus, which may destabilize the attractor, but 
it does not exhibit autonomous hopping between 
attractors; and (2) n > 1, for which hopping oc- 
curs autonomously, without the need for any exter- 
nal stimulus. In the latter far as n < A^, 
the parameter $ allows for a control of the hop- 
ping, while this always occurs at high frequency 
for n = N. For n w |-/V, the case for which we 
report some results here, the time the neuron ac- 
tivity stays at or near each attractor may be varied 
by tuning <I>, as illustrated in figure El 
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